| Name | Version | Summary | date |
|---|---|---|---|
| smoltoken | 0.1.0 | A fast library for Byte Pair Encoding (BPE) tokenization. | 2025-01-21 12:12:25 |
| kitoken | 0.10.1 | Fast and versatile tokenizer for language models, supporting BPE, Unigram and WordPiece tokenization | 2024-12-20 03:07:14 |
| tokenizers | 0.21.0 | None | 2024-11-27 13:11:23 |
| bpeasy | 0.1.3 | Fast bare-bones BPE for modern tokenizer training | 2024-08-23 10:47:52 |
| nfelib | 2.1.1 | nfelib: electronic invoicing library for Brazil | 2024-06-29 23:46:16 |
| pyregtokenizer | 0.0.2 | A BPE Tokenizer using regex | 2024-04-21 07:30:19 |
| hour | day | week | total |
|---|---|---|---|
| 49 | 1432 | 7580 | 281713 |